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Abstract —Generalized Fourier series with orthogonal 
polynomial bases have useful applications in several fields, 
including differential equations, pattern recognition, and 
image and signal processing. However, computing the 
generalized Fourier series can be a challenging problem, 
even for relatively well behaved functions. In this paper, a 
method for approximating a sparse collection of Fourier- 
like coefficients is presented that uses a collocation tech¬ 
nique combined with an optimization problem inspired by 
recent results in compressed sensing research. The dis¬ 
cussion includes approximation error rates and numerical 
examples to illustrate the effectiveness of the method. One 
example displays the accuracy of the generalized Fourier 
series approximation for several test functions, while the 
other is an application of the generalized Fourier series 
approximation to rotation-invariant pattern recognition in 
images. 

I. Introduction 

This paper discusses an efficient method to approx¬ 
imate the sparse generalized Fourier series of a given 
function in terms of orthogonal polynomials in several 
dimensions. That is, given a function / : W l —>• R 
satisfying certain properties, we seek to compute the 
Fourier-like coefficients {c n : n € W} such that 

./' ~ X dn7Tn ’ (!) 

new 

where {vr n } is a collection of orthogonal polynomials 
and W is is a sparse collection of multi-indices. 

To compute the sparse collection of Fourier-like co¬ 
efficients, we propose using a collocation method in 
an optimization scheme motivated by recent results in 
the field of compressed sensing. This method seeks a 
sparse collection of coefficients such that the finite sum 
appearing in dTJ nearly interpolates / at carefully chosen 
nodes. 
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The notion of sparsity has been increasingly em¬ 
phasized in recent literature. As the amount of useful 
data collected continues to increase, the extraction of 
meaningful data is often hindered by the so-called ‘curse 
of dimensionality’. Too alleviate its effects, methods 
exploiting any natural sparse or hierarchical structures 
in data have been developed. Research in sparse grids, 
particularly when coupled with a hierarchical scheme us¬ 
ing Smolyak’s algorithm, laid the foundation for accurate 
computation of high dimensional problems while sig¬ 
nificantly reducing the computational complexity from 
0(N d ) to 0(N log' 7 1 N), where d is the underlying 
dimensionality of the problem and N is the number of 
grid points in each coordinate direction OJ, lfl9l . 

For linear regression problems, the importance of 
sparsity has emerged in recent advances in compressed 
sensing. Given a sensing matrix X E R mxp with m«p 
and a collection of under sampled linear measurements 
y = Xc, using compressed sensing techniques one may 
approximate the sparse vector c via the optimization 
problem 

c = argmin ||c||i satisfying Xc = y. 

Under certain sparsity and coherence conditions, the 
recovery will be exact O, 0, 0, 0. 

On the other hand, sparse generalized Fourier series 
approximations with orthogonal polynomial bases typi¬ 
cally use spectral or pseudospectral approximations on 
sparse grids (6J, (9), flTTl . lfl5l . lfl6l . These methods 
determine the sparse collection of multi-indices a priori, 
which may lead to unintentional deletion of significant 
terms in the approximation. To compute the coeffi¬ 
cients in the aforementioned works, detailed hierarchical 
quadrature methods have been developed to perform 
the numerical integration required for the desired accu¬ 
racy while keeping the computational complexity low. 
Although effective, these methods can be difficult to 
implement. 


In comparison, the method proposed in this paper has 
a straightforward implementation. In addition, a major 
strength of the proposed method is that the sparse index 
set does not need to be selected in advance. Instead, the 
optimization scheme will select the best sparse selection 
of multi-indices to approximate the function. 

The following notation will be used throughout this 
work. Vectors will be denoted by boldface letters. Let 
M denote the real numbers, N the natural numbers and 
No = NU{0}. Let denote the usual d-dimensional Eu¬ 
clidean space with obvious analogues N d and Nfj. Let rij 
denote the j th entry of the vector n. Let C(fl) equal the 
space of all continuous real-valued functions defined on 
a domain fi. The space of cu-weighted square-Lebesgue 
integrable functions over M: 1 is denoted by L^(R. d ) with 
the associated weighted inner product (•, -) u defined 
by (f,g)w = fwf9 dw for all f,g G L 2 U (R d ). The un¬ 
weighted inner product naturally induces the weighted 
norm || • || w . 

The rest of this paper is organized as follows. In 
Section 2, the proposed method for approximating the 
sparse generalized Fourier series of a function is pre¬ 
sented, along with an analysis of the approximation 
error. The advantages of the proposed method arc stated 
and compared to the difficulties exhibited by existing 
methods. Section 3 includes numerical experiments in 
which the proposed method is implemented. The first 
set of experiments approximates the sparse generalized 
Fourier series of several bivariate test functions. The sec¬ 
ond set of experiments applies the sparse approximated 
Fourier-like coefficients to compute the rotation-invariant 
Gaussian-Hermite moments, and uses these moments 
to perform classification of unknown rotated images. 
The paper concludes with a summary and directions of 
possible future work. 

II. Sparse Generalized Fourier Series with 
Orthogonal Polynomial Bases 

The proposed method approximates a given function 
by a sparse generalized Fourier series with an orthog¬ 
onal polynomial basis. After selecting a set of multi¬ 
indices and evaluating the orthogonal polynomials at pre¬ 
determined nodes, the sparse collection of coefficients is 
computed using a collocation method with a convex opti¬ 
mization problem. This section explores the multi-index 
and node selection, thoroughly explains the collocation 
model used to approximate the Fourier-like coefficients 
and discusses the approximation errors. We begin with 
preliminary facts about orthogonal polynomials and gen¬ 
eralized Fourier series. 


A. Full and sparse grid orthogonal polynomial repre¬ 
sentations 

Fet C M d . Fet u : fi —>• R be a continuous weight 
function. That is, suppose u > 0 on Q and u> satisfies 



Associated with each weight function is a collection of 
orthogonal polynomials. A set {7r n : n € Ng} satisfying 
both of the following conditions is the collection of u- 
orthogonal polynomials: 

1) Each 7r n is a multivariate polynomial. 

2) (tt n , irm)^ := / 7r n 7r m dw = 0 if n / m. 

Jn 

Some common collections of univariate orthogonal poly¬ 
nomials and their associated weight functions are given 
in Table HI Ifll. 


Name 

UJ 

fi 

Chebyshev (First Kind) 

l/Vi — x 2 

[-1,1] 

Chebyshev (Second Kind) 

y/1 — x' 2 

[-1,1] 

Legendre 

1 

[-1,1] 

Laguerre 

e - * 

[0,oo) 

Hermite 

_-r;2 

e 

R 


TABFE I: Some common univariate orthogonal poly¬ 
nomials, their associated weight functions uj, and their 
domains 12. 

Fet {7r n : n £ Nq} be a collection of multivariate 
orthogonal polynomials relative to the weight uj. Suppose 
the orthogonal polynomials have been normalized so that 
117r n 11 = 1 for each n. Since the orthogonal polynomials 
relative to the weight uj form a complete orthogonal basis 
of L^(M d ), any function / € L^(R. d ) can be expressed 
as 

/ = 'y ^ C n 7T n , (2) 

nGNg 

where the equality is understood to mean convergence in 
norm and the Fourier-like coefficients are given exactly 
by 

Cn = (/,7T n )w (3) 

The expression in Equation ([2]) is called the exact gen¬ 
eralized Fourier series of /. 

The computation of Equation © presents several dif¬ 
ficulties. Not only does the full-grid generalized Fourier 
series involve infinitely many terms, but the Fourier- 
like coefficients can be difficult or impossible to com¬ 
pute exactly even for seemingly innocuous functions 
/. Moreover, it is challenging to implement numerical 







integration techniques achieving the desired accuracy 
due to the highly oscillatory behavior of the integrands. 
Therefore methods to estimate the generalized Fourier 
series © must tackle both the series truncation and 
coefficient computation issues while ensuring that the 
approximation error for one does not overwhelm the 
other. 

To tackle the series truncation difficulty, we explore 
three sets of multi-indices. Fix a positive integer N and 
consider the sets of candidate full-grid multi-indices 

Y$ = {n G Nq : n < iV| , 

T d N = {nGNMlnllr = n} , 

and the sparse-grid hyperbolic cross-shaped multi¬ 
indices 

Sjy = ^ n E Nq : | (tij + 1) < N + 1 ^ . 

Clearly \Y$\ = 0(N d ) and |S*| = 0(A^log d_1 N). It 
can be shown that Sfj C ©. These pre-determined 
multi-indices are commonly used in spectral and pseu- 
dospectral methods 0, lUTl . fT5l . llT6l . 

Define the full and sparse-grid truncated generalized 
Fourier series as 

fw ■= Y c n vr n (4) 

new 

for We{Y d ,T d ,S d N }. 

The error rates for the truncated orthogonal polyno¬ 
mial representations of a function © depend on the order 
of the approximating polynomials as well as the behavior 
of the function itself. 

Theorem 2.1: For any s > 0 and / E L^(R d ), 

Wf-fwL < N~ s \\f\\ K s, 

where W E {, T d r . Sfj } and || • || K » is the Korobov 
norm of order s induced by the inner product 

d 

(/> 5 > k » = Y (/> ^>^(5^11)0; Il ( 1 + Ti i) 2s - 

n€Ng j =1 

The proof of Theorem 12.11 regarding the accuracy of 
the full and sparse-grid truncated generalized Fourier 
series appears in 0, ifTTI for Flermite polynomial bases. 
The proof can easily be generalized to bases of other 
orthogonal polynomial classes. 


B. Fourier-like coefficients 

To tackle the coefficient computation difficulty, an 
optimization problem with a collocation method will 
be employed. To this end, Let A c R d be a finite 
collection of nodes with |A| = m, enumerated so 
that A = {xi,X 2 ,... ,x m }. Choose N, let W E 
{Y d ,T d ,Sff} and say \W\ = p. Enumerate W so 
that W = {ni, ri 2 ,..., rip}. Define the j th -row &; th - 
column entry of the collocation matrix X E M mxp by 
Xjj. = 7 Tfc(xj), and let the j th entry of the vector f E M m 
be given by f, = /(x^). 

The collocation method seeks a sparse collection of 
coefficients (c n : n E W} that satisfies 

/( x j) = 5 ° 7 r “( x j) Vx j e A - ( 5 ) 

new 

More succinctly, Equation © can be expressed as 
f = Ac. 

Although the Jacobi-like collocation matrix X is 
full rank, it is not necessarily square. Indeed, we are 
interested in the case m <S p. One could relax the 
equality in © and seek c that minimizes ||f — Ac|| 2 . 
This is exactly a least squares optimization problem with 
solution c = X^f, where X^ is the pseudoinverse of X. 
Flowever, the least squares solution does not promote 
sparsity. Unless one knew a priori the exact sparse set 
W to use, it is unlikely using least squares would result 
in a sparse representation of /. 

Instead, we propose approximating the collocation co¬ 
efficients using the Dantzig selector, which is a solution 
to the optimization problem 

minimize lie ||i 

hit- .. , ( 6 ) 

subject to ||D 1 A' t (A'c — f)11^ < 5 

where D is the m x m diagonal matrix normalizing the 
columns of X and the scalar 6 > 0 is small. Let c be a 
solution of the optimization problem ©. Then a sparse 
generalized Fourier-series approximation to the function 
/ is given by 

f = Y 6n7Fn • 

new 

Several methods exist to quickly and accurately solve 
the optimization problem ©, including an alternating 
direction method lUOl and an iterative method based 
upon proximity operators lfl2l . 

Before performing the error analysis of the approxi¬ 
mation ©, some notation must first be presented. For a 
domain D C R d , let C(Q) denote the class of all real¬ 
valued continuous functions on fl, and let 

C m (Q) = {/ : E C, V|a| < m}. 


For any positive integer m, define a seminorm 

I ' lx m (Q) on C m (n) as 

I f\x m (Q) = max||/ (Q) (x)| : x <E \a\ < mj . 

For any function / : —>• M, let the supnorm of / 

restricted to the domain be given by ||/||oo,n- 

The error in the sparse orthogonal polynomial inter¬ 
polation of a function / greatly depends on the highest 
order of the polynomials used in the summation as well 
as the smoothness and behaviour of / itself. 

Theorem 2.2: If the nodes A = 

{x : nM+i(xj) = 0} C W l are a rectangular grid 
of the zeros of the M + 1 th orthgonal univariate 
polynomial and if / € L 2 (M d ) n C m (R d ), then for 
any simply connected domain f! C l 6 * there exists a 
constant c > 0 such that 


f- E 


CnVT r 


ne« 


< c2 


—mM 


I/I 


*B(n) 


oo,f2 


The proof of Theorem 12.21 appears in ifTTl for multivari¬ 
ate Hermite orthogonal polynomials. The generalization 
to other classes of orthogonal polynomials is straightfor¬ 
ward. 

Finally, since the polynomials {vr n } are orthonormal 
relative to c o, the error in approximating f by the in¬ 
terpolated polynomial / = Gi^n is characterized 

by the difference in their coefficients: 



2 

f-f 

uj 


n£W 


C-n ) TTn 



which is guaranteed to be small provided c has a small t\ 
norm. Indeed, the constrant in (J6]) forces the coefficient 
error to be small between the recovered polynomial and 
the interpolated polynomial. 


III. Numerical Examples 

In the following experiments, the sparse generalized 
Fourier series approximation is computed for various test 
functions using the collocation approach presented in 
Section 2. In Experiment 1, various node and multi-index 
selection methods are used for several test functions. 
The accuracy of the approximation for each test function 
is presented. To illustrate the utility of the proposed 
method, the collocation method presented above is used 
to quickly generate the Gausian-Hermite moments of 
several images in a training set in Experiment 2, which 
are then used for classification of rotated images in a 
testing set. 


The Hermite polynomials are used as the orthogonal 
basis in the sparse representations. Consider the collec¬ 
tion of orthogonal univariate Hermite polynomials with 
associated weight function w(x, y) = e~( x +y \ The first 
few univariate Hermite polynomials prior to normaliza¬ 
tion are ttq{x) = 1, 7Ti(x) = 2x, ^(x) = 4x 2 — 2, and 
satisfy the three term recurrence 

7T n+ i(x) = 2x7T n (x) - 2n7T n _i(x) 

for n € N. Since t o is separable, the multivariate Hermite 
polynomials are products of the univariate ones: 

7T n (x) = 7T ni (xi)7Tn 2 (x 2 ) ■ • • TT nd (x d ). 

The polynomials are then normalized as 



To find the solution to the optimization problem ©, 
we use the proximity operator based iterative method 
recently proposed in lfT2]l . The proximity operator based 
method is straightforward and uses only two soft thresh¬ 
olding operations at each iteration, requiring 0(4mp) 
multiplications in each iteration for a mx p collocation 
matrix X. 

All experiments arc performed in MATLAB 2014a on 
a PC with an Intel Core i7-3630QM 2.40 GHz processor 
and 16GB RAM running Windows 7 Enterprise with 
machine precision 2.2204e — 16. 

Experiment 1. 

In this experiment, the sparse generalized Fourier se¬ 
ries approximation several given functions are computed. 
Suppose d = 2 and consider the functions 

/i(x, y) = xV 
/ 2 (x,y) = xV 
h{x,y) = xe y/2 . 

It is easy to check that fj E L 2 (M 2 ) for each j. 

To create the collocation matrix X for use in the 
scheme ©, we use the full-grid rectangular, triangular 
and a sparse-grid hyperbolic cross shaped set of can¬ 
didate multi-indices, and Sfj, along with nodes 

formed by a rectangular collection the zeros of the M de¬ 
gree univariate Hermite polynomials. The parameter N 
determines the highest degree hermite polynomial used 
in the approximation, and the parameter M determines 
the number of nodes used as collocation points. 

Figure Q] displays the sparse generalized Fourier Her¬ 
mite approximations of the functions / 2 , fz with the 
coefficients computed as in ([6]), and Table |TT] gives 
the error in computing the coefficients as in © of 
















Fig. 1: The exact function (left), the approximated generalized Fourier series (center) and the pointwise approxi¬ 
mation eiTor (right) for the functions /2 (top row) and (bottom row) in Example 1. The approximations for /2 
use Y? as the collection of multi-indices and M = 5. The approximations for fe use V i 2 j and M = 10. 


w 

M 

2 

3 

4 

N 

5 

6 

7 

8 

9 



N-l 

3.1250e-01 

1.8750e-01 

1.5830e+00 

6.9389e-17 

1.3597e-16 

2.3967e-16 

8.7694e-16 

2.0015e-16 



N 

1.8750e-01 

2.3097e-16 

6.9389e-17 

1.6303e-16 

2.3967e-16 

1.2178e-16 

2.0015e-16 

1.2478e-15 



N+l 

2.3097e-16 

6.9389e-17 

1.6303e-16 

2.3967e-16 

1.2178e-16 

2.0015e-16 

1.2478e-15 

5.4918e-16 



N-l 

3.0619e-01 

1.7678e-01 

1.7922e-01 

6.9389e-17 

7.9722e-17 

6.2450e-17 

3.0938e-16 

6.7987e-17 

<e < 


N 

1.7678e-01 

3.0619e-01 

6.9389e-17 

1.2432e-16 

6.2450e-17 

9.3095e-17 

6.7987e-17 

7.8505e-17 



N-l 

3.0619e-01 

1,0607e+00 

1.2432e-16 

1.6997e-16 

9.3095e-17 

4.6548e-16 

7.8505e-17 

5.1962e-15 



N-l 

3.0619e-01 

1.7678e-01 

3.0619e-01 

1.0607e+00 

2.3117e+00 

4.0620e+00 

1.1938e-16 

1.6464e-15 


CO 

N 

1.7678e-01 

3.0619e-01 

1.0607e+00 

2.3117e+00 

4.0620e+00 

6.3122e+00 

1.6464e-15 

2.5542e-15 



N+l 

3.0619e-01 

1.0607e+00 

2.3117e+00 

4.0620e+00 

6.3122e+00 

9.0623e+00 

2.5542e-15 

6.4896e-15 



N-l 

7.2220e-01 

7.3931e-01 

8.2504e-02 

1.3435e-02 

1.6915e-03 

2.6417e-04 

2.0687e-04 

2.065 le-04 



N 

9.5017e-02 

1.6675e-02 

2.1038e-03 

2.5979e-04 

2.0466e-04 

2.0642e-04 

2.0650e-04 

2.065 le-04 



N+l 

1.0174e-02 

1.2818e-03 

1.9914e-04 

2.042 le-04 

2.0642e-04 

2.0650e-04 

2.065 le-04 

2.0627e-04 



N-l 

7.1773e-01 

6.6775e-01 

1.6675e-02 

2.1038e-03 

2.5979e-04 

2.0466e-04 

2.0642e-04 

2.0650e-04 

< 


N 

5.0888e-02 

1.0174e-02 

1.2818e-03 

1.9914e-04 

2.0421e-04 

2.0642e-04 

2.0650e-04 

2.065 le-04 



N+l 

1.4089e-01 

4.8298e-02 

1.5351e-02 

3.8721e-03 

9.1676e-04 

3.1805e-04 

2.1067e-04 

2.0025e-04 



N-l 

6.4201e-01 

6.6292e-01 

1.4089e-01 

4.8298e-02 

1.0762e-01 

4.4839e-02 

9.2400e-02 

2.5983e-02 


Co 

N 

1.1713e-02 

1.4089e-01 

3.2214e-01 

1.0762e-01 

1.7750e-01 

9.2400e-02 

1.6179e-01 

4.6104e-02 



N+l 

1.4085e-01 

3.2214e-01 

5.3508e-01 

1.7750e-01 

2.6136e-01 

1.6179e-01 

2.5687e-01 

6.7726e-02 


TABLE II: The £2 vector norm error ||c — c|| 2 for the generalized sparse Fourier series expansions f\ and fe from 
Experiment 1 for various combinations of N and M. 



































the test function /i for each multi-index scheme with 
M € {N — 1, N, N + 1} for N = 2,3,..., 9. In 
particular, the exact Fourier Hermite series expansion 
of /i has exactly 4 nonzero coefficients located at the 
multi-indices I\ = {(0,0), (0, 2), (2, 0), (2, 2)}. As seen 
in Table [III the locations and values of the nonzero 
coefficients were approximated well provided I\ C W, 
and not well when I \ (f_ W. Similarly, the exact Fourier 
Hermite series expansion of fi has exactly 9 nonzero 
coefficients located at I 2 = {(ni, 712 ) : rij = 0, 2,4}. On 
the other hand, the exact Fourier Hermite series expan¬ 
sion of /3 contains infinitely many nonzero coefficients. 
However, as in the Taylor expansion of the exponential 
function, the coefficients decay quickly and an accurate 
approximation can be obtain by using only a few terms, 
as seen in Figure [Q 

From Table lU one can see the drawbacks of using the 
predetermined sparse multi-index set Sfj. The parameter 
N must be much larger to achieve accuracy on par 
with the full-grid rectangular and triangular index set 
implementations, even for a function as simple as / 1 . 

Experiment 2. In this experiment, the sparse Fourier- 
Hermite series approximation is used to perform pattern 
recognition of unknown images with possible rotation. 
The Fourier-like coefficients are used to compute the 
rotation invariant Gaussian-Hermite moments of orders 
2,3, and 4, which are then used to classify the unknown 
images. 

Consider a collection of images in the training set 
Tr = {I\,l 2 , ■ ■ ■ ,Ik}, where each M x M image has 
been transformed to a M 2 x 1 vector. For each vector I, 
in the training set, the Fourier-like coefficient vector c,; 
is computed as in Equation © where the collocation 
matrix X is slightly changed. Instead of using the 
Hermite polynomials, each entry in X is an evaluation 
of a Hermite function Xj^ = 7Tfc(xj) exp(— ||xj |||/2). 
Throughout this example, the triangular multi-index set 
is used. Although the pixels in each image naturally 
form an equally spaced collection of nodes, for compu¬ 
tational convenience the nodes are mapped to Zm x Zm, 
where Z rn are the zeros of the M th Hermite univariate 
polynomial. 

From the Fourier-like coefficients approximated using 
the optimization and collocation method as in ©, one 
can approximate the Gaussian-Hermite moments of an 
image. 

Theorem 3.1: Suppose / € L 2 (M 2 ) and let c be a 
solution to © using the orthogonal hermite function 
basis. Then the elements of c approximate the geometric 


Gaussian-Hermite moments defined by 


m n 


f(x,y)ir n (x,y)e 0 2 +y 2 )/ 2 dxd y. 


Proof: Using an orthonormal hermite function basis 
in © yields the approximation 

fix, y) = ^2 c n ^n{x,y)e~ < ' x2+y2)/2 

lieW 

similar to ©. Substituting the above result into the 
formula for the geometric Gaussian-Hermite moments 
yields 


m r 


f{x,y)TT n (x,y)e {x2+y2)/2 dxdy 

'^2c t ir t (x,y)ir n (x,y)e~i x2+y2 ' > dxdy 

t 

^2 dt 


n/uj > 


tew 


which reduces to just the element c n since the hermite 
polynomials are orthonormal relative to the weight oj. ■ 

Although Theorem 13.11 is written in the continuous 
case, the discrete case follows by a straightforward 
substitution of summations for integrations. Using the 
Hermite functions instead of the Hermite polynomials is 
important and guarantees that the Fourier-like coefficient 
vector is a close approximation to the corresponding 
Gaussian-Hermite moment for each index in R 2 n . From 
a small collection of these approximated Gaussian- 
Hermite moments, one can determine the rotation in¬ 
variant Gaussian-Hermite moments fj of orders 2, 3, 
and 4. A list of the formulas for these rotation invariant 
moments is given in the Appendix. 

For this experiment, seven images form the training 
set. These images are 8 -bit grayscale 50 x 50 images 
of simplified Chinese characters, which were studied 
in lfT7ll . The training set is displayed in the top row of 
Figure [2] Note that Images 1-3 arc visually similar, as 
are Images 4-5 and Images 6-7. The testing set Ts is 
formed by rotating the images in the training set and 
adding noise: 


Ts = {Rqv + z : v € Tr, 6 € {0, vr/4, 7t/2, ... , 7-^/8} , 


where the operator Rg performs counterclockwise ro¬ 
tation through an angle of 6, and z is a collection of 
independent and identically distributed normal random 
variables with mean 0 and standard deviation a. For any 
vector x in the training or testing set, let 4> x €= M 11 
be the vector of the rotation invariant Gaussian-Hermite 



White Noise 

Bit-flip 

a 

Identified 

Categorized 

Identified 

Categorized 

0.00 

1.0000 

1.0000 

1.0000 

1.0000 

0.05 

0.9764 

1.0000 

0.8032 

0.9932 

0.10 

0.9657 

1.0000 

0.6950 

0.9593 

0.15 

0.9421 

0.9975 

0.6107 

0.8782 

0.20 

0.9175 

0.9979 

0.5007 

0.7653 

0.25 

0.9079 

0.9943 

0.4000 

0.6250 


TABLE III: Average ratio of images correctly identified 
and sorted into the three categories over 50 simulations 
using all images in the testing data set with white Gaus¬ 
sian noise at level a and bit-flipped pixels at proportion 
a. 

moments of orders 2 thru 4 corresponding to the vector 
x. 

To perform classification of the rotated images, say 
x e Ts is classified as a rotation of image y e Tr iff 

IlSx-Sylli < ||$x-$z|li Vz € Tr. 

To test the accuracy of the described classification 
method, the elements in Ts were classified 50 times 
each for a = 0,0.05,0.10,0.15,0.20, corresponding to 
0%,5%, etc. noise corruption. The average percentage 
of correctly classified digits in the testing data set for 
each noise level is shown in Table UTI] More details for 
the values of ||4 >.r , 2! ; — ^Hi for all v,y E Tr are shown 
in Table |TV] It is clear from the table that although many 
of the images are visually similar, the rotation invariant 
Gaussian-Hermite moments are similar only for rotations 
of the same images. Of course, if the Gaussian-Hermite 
moments are approximated well, then this method is 
expected to yield 100% classification accuracy. The nov¬ 
elty comes from computing the method used to compute 
the Gaussian-Hermite moments. Employing the solution 
of © is an elegant way to compute the moments without 
using quadrature schemes or hierarchical methods JH, 

m. 

IV. Summary 

In this paper, a method for computing a sparse gener¬ 
alized Fourier series with orthogonal polynomial bases 
of multivariate functions was presented. The method first 
uses a truncated set of multi-indices, then approximates 
the coefficients using the solution of an optimization 
problem involving a collocation model. Several examples 
were presented to illustrate the accuracy and utility of 
the proposed method. In the first set of experiments, the 


sparse generalized Fourier series approximation of sev¬ 
eral test functions were computed, and the approximation 
errors were presented. In the second set of experiments, 
the coefficients in the sparse generalized Fourier series 
were computed and used as rotation invariant feature 
vectors to perform pattern recognition on unknown ro¬ 
tated images. 
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Fig. 2: The images forming the training set and testing set from Example 2. The top row contains the seven images in 
the training set and the remaining images form the testing set of images rotated counterclockwise 0°, 45°, 90°, 135°, 
etc. 


k\j 

1 

2 

3 

4 

5 

6 

7 

1 

6.9480e-09 

4.9948 

4.5607 

7.4822 

10.5865 

6.2996 

8.6762 

2 

4.9948 

2.1222e-09 

2.9397 

8.0141 

11.3291 

7.4386 

7.0308 

3 

4.5607 

2.9397 

3.4982e-09 

6.7547 

10.4790 

6.5229 

7.5554 

4 

7.4822 

8.0141 

6.7547 

9.8842e-10 

6.7450 

4.0142 

5.3556 

5 

10.5866 

11.3291 

10.4790 

6.7450 

9.2692e-10 

6.1498 

6.7113 

6 

6.2996 

7.4386 

6.5229 

4.0142 

6.1498 

3.9752e-09 

3.5455 

7 

8.6762 

7.0308 

7.5554 

5.3556 

6.7113 

3.5455 

1.9313e-09 


TABLE IV: Values of || ( I> ;J . — T j h |,, where x is the element Ij € Tr with a 90° rotation. 


















Appendix 


[19] C. ZENGER, Sparse grids. Parallel Algorithms for Partial Dif¬ 
ferential Equations, W. Hackbusch (ed.), Notes on Numerical 
Fluid Mechanics. 31, Vieweg, (1991). 

01 =m 20 + mo2 
fa =(m 3 o + mu ) 2 + (m 0 3 + m. 2 i ) 2 
fa =(m 2 o - m 02 )[(m 30 + m 12 ) 2 - (m 0 3 + m 21 ) 2 ] 

+ 4mn(m 30 + mi 2 )(m 0 3 + m 2 i) 

fa =mii[(m 30 + mi 2 ) 2 - (m 0 3 + m 21 ) 2 ] 

- {m 20 - m 02 )(m 30 + m 12 )(m 03 + m 2 i) 
fa =(m 30 - 3 m 12 )(m 30 + mi 2 )x 

x [(m 30 + mi 2 ) 2 - 3(m 03 + m 2 i) 2 ] 

+ (m 0 3 - 3 m 2 i)(m 0 3 + m 21 )x 
x [(m 03 + m 2i ) 2 - 3(771,30 + mi 2 ) 2 } 
fa =(m 30 - 3m 12 )(m 03 + m 21 )x 

X [(77703 + 771 2 i) 2 - 3(t71 30 + 771i 2 ) 2 ] 

- ( 3 m 21 - 77103) (77130 + 77 ii 2 ) x 

X [(77130 + 771l 2 ) 2 - 3(77103 + TH^] 

fa =77140 + 2?7l 22 + 77104 

fa =(77740 - 77704) [(77130 + 777l 2 ) 2 - (777 2 l + 77103) 2 ] 

+ 4(77731 + 777 13 )(?71 3 0 + ?77l 2 )(?77 2 i + 777 0 3) 
fa =(77731 + 777i 3 ) [(?7l30 + 777 i 2 ) 2 - (777 2 1 + ?7lo 3 ) 2 ] 

010 =(77740 - 6771 22 + 77704) [(77730 + ?77l 2 ) 4 

- 6(77730 + ?77 12 ) 2 (?71 21 + 771Q3 + (t?7 2 i + ?71 0 3) 4 ] 

+ 16(77731 - 777l 3 ) (?7l30 + 777l 2 )(?71 2 l + 777 0 3)x 
X [(77730 + 777i 2 ) 2 - (t77 2 i + ?7l 0 3) 2 ] 

011 =(77740 - 6?71 22 + ?77 0 4)(77730 + 777 12 )(?77 21 + 777 0 3)x 
X [(77721 + 77703) 2 - (77730 + 771l 2 ) 2 ] 

- (77131 - 777l 3 ) [(77730 + 77712) 4 

6(?7730 + 777 i 2 ) 2 (777 2 l + 777Q3) 2 + (77721 + 777 0 3) 4 ]- 


Below are the complete and independent set of rota¬ 
tion invariants of Gaussian-Hermite moments of orders 
2, 3 and 4 (HJ. 


